Probing surface states of topological insulator: Kondo effect and Friedel oscillation 

under magnetic field 
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We address three issues on the role of magnetic impurities in the surface state of a three di- 
mensional topological insulator. First, we prove that the Kondo effect of the topological surface 
is essentially the same as that of the graphene surface, demonstrating that an effective impurity 
action of the topological surface coincides with that of the graphene surface. Second, we study the 
role of the z-directional magnetic field (h) in the Kondo effect, and show that the peak splitting 
in the impurity local density of states does not follow the /i-linear behavior, the typical physics in 
the soft-gap Kondo model. We discuss that the origin is spin locking in the helical surface. Third, 
we examine the Friedel oscillation around the magnetic impurity. It turns out that the pattern of 
Friedel oscillation in the helical surface is identical to that of the graphene surface, displaying the 



inverse-square behavior 



if the inter-valley scattering is not introduced in the graphene case. 



However, introduction of the magnetic field leads the electron density of states from the inverse- 
square physics to the inverse behavior ~ r~ l in the topological insulator's surface while it still 
remains as ~ r~ 2 in the graphene Kondo effect. We discuss that this originates from spin flipping 
induced by magnetic field. 



PACS numbers: 71.27.+a, 75.20.Hr, 73.90,+f, 75. 30. Mb 



I. INTRODUCTION 

It has been one of the main research interests to un- 
derstand topological states of matter in modern con- 
densed matter physics^ Electrons in two dimensions un- 
der strong magnetic field form such a topological state, 
exhibiting the quantum Hall effect (QHE) with gapless 
chiral edge modes protected by topology^ Later, Hal- 
dane proposed an interesting toy model to show the QHE 
without Landau levels, basically the tight-binding model 
for spinless electrons in the honeycomb lattice with a 
complex next-nearest-neighbor hopping parameter.— Re- 
cently, Kane and Mele extended the Haldane model into 
the case of spinful electrons, where each spin observes 
an opposite fictitious magnetic flux, realized by the spin- 
orbit coupling and preserving time reversal symmetry^ 
Analogous with the QHE, this insulating state shows the 
spin QHE, where the difference of the spin f and J, Hall 
conductances is quantized. When the spin quantum num- 
ber is not conserved due to the presence of the Rashba- 
type spin-orbit interaction, the spin Hall conductance 
cannot be used for topological characterization. Kane 
and Mele proposed the Z2 index, counting the number of 
helical edge states with modular 2, and concluded that 
the odd Z2 index state corresponds to a topological state 
of an insulator, which cannot be adiabatically connected 
to the even Z 2 state of a trivial insulator^ 

Immediately, it was performed three dimensional 
generalization of the two dimensional Z2 topological 
insulator.— ~— It turns out that the surface state of the 
three dimensional topological insulator has an odd num- 
ber of helical Dirac fermions,— identified with an odd Z2 
index, where spins are locked along the momentum di- 
rection on the surface. Since there is no QHE analogue 



in three dimensions, the three dimensional topological 
insulator has been regarded as a new quantum state of 
matter. 

An interesting prediction is associated with the sta- 
bility of the helical metallic state against time rever- 
sal symmetric perturbation, where it should be stable 
against Anderson localization independent of the disor- 
der strength^ In addition, the topological term appears 
due to the chiral anomaly in the field theory context, giv- 
ing rise to electric polarization along the magnetic field 
direction when time reversal symmetry breaking field is 
applied infinitcsimallyi 10 ' 1 1 

Although the topological insulator was now verified 
cxperimcntallyj^r— the angle reserved photo emission 
spectroscopy (ARPES) is the only experimental probe, 
not performed on the table top. In this respect it is de- 
sirable to propose table top experiments for three dimen- 
sional topological insulators. Recently, an experimental 
realization of the magnetic doping on the surface of three- 
dimensional topological insulator was reported J£ 

In this paper we propose how to probe the sur- 
face state of the topological insulator, investigating the 
Kondo effect and Friedel oscillation under magnetic field. 
Since spins of host electrons are locked along the mo- 
mentum in the topological surface, one may expect 
under-screening for a magnetic impurity in contrast with 
the soft-gap Kondo physics^ expected to arise in the 
graphene surface, — However, it turns out that the Kondo 
effect of the topological surface is essentially the same as 
that of the graphene surface. Integrating over host elec- 
trons, we also prove that an effective impurity action of 
the helical metal coincides with that of the soft-gap An- 
derson model. This precise demonstration tells us exact 
impurity screening at hybridization enough to overcome 
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the vanishing density of states. In order to distinguish 
the Kondo effect of the topological surface from the soft- 
gap Kondo effect, we introduce magnetic field in the z- 
direction (h). We show that the peak splitting in the im- 
purity local density of states does not follow the /i-linear 
behavior, the typical physics in the soft-gap Anderson or 
Kondo model. We derive an analytic expression based 
on the picture of spin locking in the helical surface. 

Finally, we examine the feedback effect of the impurity 
dynamics to host electrons, evaluating the host-electron 
local density of states (LDOS) and revealing the Friedel 
oscillation around the magnetic impurity. The LDOS is 
measurable by Fourier transformation scanning tunneling 
spectroscopy (FTSTS). The FTSTS measurements have 
been developed for graphene , 19 ! 20 as well as other two di- 
mensional materialsi 21 i 22 The LDOS in graphene was also 
investigated theoretically.— It turns out that the pattern 
of Friedel oscillation in the topological surface is identical 
to that of the graphene surface without magnetic field, 
displaying the inverse-square behavior ~ r~ 2 if the inter- 
valley scattering is not introduced in the graphene case, 
where r is the distance from the impurity position. How- 
ever, introduction of the magnetic field leads the LDOS 
from the inverse-square physics to the inverse behavior 
~ r^ 1 in the topological insulator's surface while it still 
remains as ~ r~ 2 in the graphene Kondo effect. We dis- 
cuss that this originates from spin flipping induced by 
magnetic field. 

This study addresses three issues on the role of mag- 
netic impurities in the surface state of a three dimensional 
topological insulator. First, we prove that the Kondo ef- 
fect of the topological surface is essentially the same as 
that of the graphene surface. Second, we study the role 
of the z-directional magnetic field (h) in the Kondo ef- 
fect, which turns out to differ from the typical physics in 
the soft-gap Kondo model. Third, we examine the effect 
of the magnetic field on the Friedel oscillation around 
the magnetic impurity. The previous studies of Refs. [24] 
and Hfl addressed the first issue, where the effect of the 
magnetic field is absent. The Ref. Hi] uses the varia- 
tional method to study the Kondo effect, which is an 
approximation, thus not a rigorous proof for the equiv- 
alence of the Kondo effect in the topological insulator 
and graphene, although this study can give fruitful in- 
formation such as spin correlations. The Ref. [25] also 
pointed out the equivalence based on a different choice 
of the unitary transformation, and we compare these two 
different transformations. However, the other two issues 
have been discussed only in our study, and they are essen- 
tial to probe the surface states of topological insulators. 

The present paper is organized as follows. In Sec. II 
we derive an effective impurity action from the Anderson 
model, mapping the model into an effective one dimen- 
sional action and integrating over such one dimensional 
host electrons. Performing the slave-boson mean-field 
analysis, we show that the peak splitting of the impurity 
density of states under magnetic field differs from the 
standard Zeeman energy proportional to the magnetic 



field. In section III we present the host-electron LDOS 
and its local charge density. They reveal that the decay 
of the Friedel oscillation changes from an inverse-square 
law to an inverse law, applying magnetic field. In section 
IV summary and discussion are presented. 

II. IMPURITY DYNAMICS 

A. Equivalence between the Kondo effect of the 
helical metal and the soft-gap Anderson model 

1. An effective impurity action in the helical metal 

We start from an Anderson model in two dimensions 

#hel = X] C kA v F( k ' tr )<r<r' ~ /V<W]c ko -' + /Efaflfo 
kcrcj' <y 

+ ^F(k)/t CkCT + H.c. + C/n{nf. (1) 

kcr 

c ik(T ( c ker) is the creation (annihilation) operator for host 
electrons with momentum k = (k x ,k y ). This metallic 
host is given by the surface of the topological insulator, 
where the k • er term locks the electron spin to its mo- 
mentum, named as helical metal, vf is the Fermi velocity, 
and o~ x , a v are the Pauli matrices, a = ±1 is the spin 
index, and \i a = fi + ah is an effective chemical potential, 
where h is the magnetic field. j\ {f a ) represents the cre- 
ation (annihilation) operator for the magnetic impurity. 
Ef a = Ef — ah is an effective impurity energy level with 
the Zeeman energy contribution. U is the Coulomb in- 
teraction at the impurity site. V(k) is the hybridization 
between the impurity and helical electrons, assumed to 
be V(k) = V for simplicity. 

In order to map this Hamiltonian to one dimensional 
model, we write k = fc(cos(</>), sin(<^>)), where k = |k| and 
(f> is the angle of the momentum k from the x-axis. The 
Hamiltonian for helical electrons without magnetic field 
can be rewritten as 

#hel= E £fe 4 CT M^(0)<W, (2) 
\tcrcr f 

where Sk = v-pk is the energy dispersion, and 

e o") (3) 

expresses the spin-momentum coupling. Introducing the 
unitary transformation 

m = ^ ( e l ) , (4) 

the Hamiltonian ([2]) is diagonalized as follows 

kcr 
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where 7k = {4>)c\t. Expanding the 7k<r operator in the 
basis of angular-momentum eigenmodesii 



7ko- 



1 1 

Vk V 7 ^ 



$> ml0 7 mCT (fc), 



(6) 



where m is an integer representing angular momentum, 
we rewrite the Hamiltonian ([5]) as 



oo 

H hd = Yl J dke k cr^ nr7 (k)-f m<J (k). 



(7) 



The hybridization term in Hamiltonian ([T]) becomes 
— 00 

Vnv 



hyb 
hel 



/ dfcVfc[#yot(*) + fhoi(k) 



+ /j7-it(*)-/l7-u(*)]+H.c 



(8) 



in the 7 TOCT basis, where iV is the number of surface states. 
Note that only the s- (m — 0) and p- (m = —1) wave 
components contribute to the hybridization between the 
impurity and conduction electrons. This is typical in the 
Dirac spectrum,— resulting from (1, e 1 ^) in the unitary 
matrix while only the s-wave scattering is relevant in the 
presence of the Fermi surface. 
The Zeeman term is 

oo 

HL = -hJ2 I *[7l t ( fc )^W+7^(fe)7mt(fc)] (9) 

m { 

for helical electrons. Remember that the magnetic field 
is applied in the z-direction. Since spins are locked along 
the momentum direction in the plane, the magnetic field 
should flip the spin in order to get its z-component. As 
a result, helical electrons at the momentum hp couple to 
those at — kp in the presence of magnetic field. As will be 
discussed in the next section, this is the reason why the 
inverse square behavior in the Friedel oscillation pattern 
turns into the inverse form. On the other hand, this spin- 
flip process is not introduced into the conventional soft- 
gap Anderson model by the magnetic field, showing the 
inverse square law as long as the inter-valley scattering 
is not taken into account.— 
It is convenient to consider 





7/| (t°t ( fc ) + 


701 0)), 


(10) 


Ipki = 


^(7-it(*) 


-7-u(*)), 


(11) 


Vk\ = 


-^=(7ot(fc) - 


701 0)), 


(12) 


fki. = 


^(7-it(*) 


+ 7-il(*0)- 


(13) 



One can verify that these operators satisfy the fcrmionic 
anticommutation relations. Rewriting the Hamiltonian 



rfka 



([T]) in this new basis, we obtain 

oo 

■Hhel = E / dfe fc(^L^fc<r +<PL^* 
ff 

OO 

- E / dk (^ka^k<x + (i-vVko 
° 

(T 

OO 

+ E J dkVkf^k, + H.c, (14) 

a o 

where the impurity couples to only f/v-electrons. 

Integrating over the ip a fields, we obtain the effective 
action 

P P oo 

Shel =J2jdrJdrjdki,l(T)[g^\k,T- r')}- 1 ^') 

a 

p p 

+ E/ dTfl{T)[d T +E }a ]Ur) + U J drn{{T)n{{r) 



Et|=- JdrJ dkVkft(T)Tp k<T (T)+K.c, (15) 

a ^00 



where 



(iuj + Ho){iu> + H-o) - (£-fe) 2 



(16) 



is the ip a Green's function. Integration of the ip a fields 
gives rise to an effective action for dynamics of the mag- 
netic impurity on the surface of the topological insulator 

P 

SW = E / drp a (T)[S(T-r')(d T +E fa ) 
° o 

P 

+ J^\t-t')]U{t') + U J drref(r)n{(r), (17) 

o 

where 

oo 

A^M = W- J dkkg^\k, iu>) (18) 
o 

is the hybridization function. Using the Lorentzian 
cutoff,— we obtain the hybridization function 

oo 

AJ-M-^/****^ A " F 



2- 



r 2k{iu + [I -ah) ^ 



7T v F k 2 + A 2 



A 2 



(iw + fi) 2 - h 2 + A 2 b h 2 - {iuj + /i) 2 ' 
where A is a cutoff in energy and T = N\V\ 2 /A-K 2 vp 



(19) 
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2. An effective impurity action in the soft gap metal 



We consider the soft-gap Anderson model 



kcta'<T 

+ Y^l'tit' + Uri{ n{ 

a 

+ ^y(k)/t CkQ(T + H.c.. (20) 

kacr 

The notation in the Hamiltonian (|20p is the same as that 
in Eq. (fTJ) except for the conduction electrons which now 
have an additional branch notation a, ex! — ±1, associ- 
ated with the Pauli matrix cr aa i . This may be interpreted 
as pseudospin, which can result from two sublattices in 
grapheneJ^ In addition to this pseudospin index, there 
exists another Dirac cone in graphene, called valley. In 
this study we take into account only one valley to focus 
on the comparison with the helical metal. In the soft- 
gap metal momentum is not tied to the electron spin, 
instead the pseudospin. This feature differs from helical 
electrons. 

Proceeding in the same way as in the previous subsec- 
tion, we obtain 

oo 

771=0,-1 O.CT q 



'NV x - 



dkVkfl[yo,+,<r(k) +7o,-,<r(fc) 



7-l, + .<x( fc ) - 7-1. -,v( k )] + Hx - 



(21) 



where the jma<r(k) basis diagonalizcs the conduction elec- 
tron part of Hamiltonian (f2"U)) . Note that the pseudospin 
a plays the same role as the spin of the helical metal, 
where the pseudospin mixing appears in the hybridiza- 
tion term. 

We introduce tpi^(k) = 7 ,+, CT (fc) for k > 0, and 
ipi.a(k) = 7o,-, CT (fc) for k < 0; ip 2 ,a(k) = 7_i )+1<7 (fc) for 
k > 0, and ip2,a{k) = — 7-i.-.er(fc) for k < 0. These new 
operators allow us to rewrite the Hamiltonian (|2ip in the 
following way 

oo 

H sg = Yj / dk (£k - H*)lpla( k )lpaa(k) 

' ■ — oo 



f f 



^ E / ^^/]Vw(fc)+H.c.(22) 



Note that the magnetic field in the soft-gap metal couples 
to electrons with the same spin and pseudospin. There is 



no spin-flip or pscudospin-flip process, induced by mag- 
netic field. 

Integrating over the i\) aa field, we obtain an effective 
impurity action from the soft-gap Anderson model 

Ss S = £ J drfl{r)[8{T-r')(d T + E fa ) 



+ Af(r-r')]f a (r') + U J drn{(r)n{(r), (23) 

o 



where 



N\V\ 2 



f dk \ k \ 

7T *— ' J iLJ + \l a 



- £k 



_ 4A(iw + /v) -A 2 
= - r 7-^ \TZ a 2 lo g7-— 24 

is the hybridization function. 

3. Discussion 

It is quite interesting to see that the effective impurity 
action in the helical metal is essentially identical with 
that in the graphene case without magnetic field. The 
only difference is the factor 2 in the hybridization func- 
tion of the soft-gap metal, resulting from the pseudospin 
symmetry. This completes our proof that the magnetic 
impurity on the surface of the topological insulator is 
screened exactly, the same as the Kondo effect in the 
soft-gap Anderson models The identity of the effective 
impurity action in the helical metal and graphene was 
also pointed out in Ref. [2ft 

An interesting point is the choice of the unitary ma- 
trix for diagonalization. In this paper we choose the 
single-valued function as the unitary matrix, given by 
e 1 ^. On the other hand, the previous studies^^ took the 
double-valued function e 1 ^/ 2 in the unitary matrix. Al- 
though this kind of non-single- valued function can be uti- 
lized in principle, the branch-cut should be taken into ac- 
count with an additional phase factor carefully. However, 
an effective impurity action based on this double- valued 
unitary transformation is completely identical with that 
based on the single-valued unitary transformation. In 
appendix we perform the same procedure to find the ef- 
fective impurity action. 



B. U(l) slave-boson mean-field analysis in the 
presence of magnetic field 

Although the Kondo effect in the helical metal is com- 
pletely the same as that of the soft-gap Anderson model 
without magnetic field, it becomes much different, ap- 
plying magnetic field. This originates from the fact that 
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FIG. 1: The spin f and 4- splitting energy of the Kondo peak 
under magnetic field in the spectral density of the impurity : 
r = 1, A = 50, fj, = 0.1, T = 0.01, E f = -6.2 for the helical 



case and Ef = —12.4 for the soft gap case. 



the magnetic field gives rise to the spin-flip process in 
the helical metal while there is no such a term in the 
graphene. This is reflected on the magnetic-field depen- 
dence of the hybridization function. To reveal the effect 
of the magnetic field, we use the slave-boson mean-field 
approximation in the U — > co limit. The electron oper- 
ator at the impurity site is decomposed as f a = d a b\ 
where d a is a fermion operator and b is a boson one^ A 
constraint should be imposed to match the Hilbert space 
of the original electron representation with that of the 
slave-boson expression, given by 



(25) 



cost induced by the magnetic field in the z-direction be- 
comes 

AE{6] = ak F S (1 - cos 9) -hS sin 9, (27) 

where the first contribution results from the spin-locking 
kinetic term k ■ er and the second is the Zeeman energy. 

5 is the size of spin and k F is the Fermi momentum, a is 
a positive numerical constant, depending on the micro- 
scopic detail associated with the Fermi surface geometry. 

6 is an angle from the xy plane to the z-direction, used 
to be the variational parameter. Minimizing the energy 
with respect to 9, we obtain 



cos ( 



ak F 



^/h 2 + {ak F ) 2 ^h 2 + (ak F ) 

As a result, the peak splitting is given by 



(28) 



(29) 



differentiated from the typical D(h) = 2Sh behavior. 

If the magnetic field lies in the x-direction, the energy 
cost becomes 



D(h) = 2S[ yjh? + (ak F ) 2 - aki 



AE%] 



d<t> 
2^ 



k F S(cos(4> — 9^) 



/iScos(0 )](3O) 



where 9^ is the angle between the spin and x-direction. 
Minimizing the energy with respect to 9$, we obtain 



tan(00) 



kp sin(0) 



k F cos(</>) — h 
The corresponding minimum energy becomes 



(31) 



In the mean-field approximation the boson operator is 
replaced by its average value (b) = b, and the constraint 
equation (|25p is taken into account by its average version. 
The impurity Green's function is given by 



1 



u-E 



fa 



b 2 A a (u 



(26) 



where Ef a = Ef a + A is an effective energy level and A is 
the Lagrange multiplier to impose the slave-boson con- 
straint. We consider the chemical potential of conduc- 
tion electrons slightly above the Dirac point, i.e., \i > 0. 
Fig. Q] shows the splitting energy of the spin f and i 
Kondo peaks in the spectral density of the impurity un- 
der magnetic field. In the case of the soft-gap Anderson 
model D = 2h results, as expected. On the other hand, 
the Kondo-peak splitting in the helical metal deviates 
from the typical ^-linear behavior. This property distin- 
guishes the Kondo effect of the helical metal from that 
of the soft-gap Anderson model and would be observed 
experimentally. 

Physics behind this deviation lies in the spin locking 
along the momentum direction in the plane. The energy 



AE = S 



do 
2^ 



^k 2 F + h 2 - 2k F hcos{(j)) - Sk F . (32) 



Expanding the minimum energy in h, one can show that 
the linear term vanishes. As a result, the peak splitting 
D(h) ~ h 2 as in the case of the magnetic field in the 
z-dircction. 



III. FRIEDEL OSCILLATION IN LOCAL 
CHARGE AND SPIN DENSITIES OF 
CONDUCTION ELECTRONS 

In the previous section impurity dynamics was investi- 
gated, considering two kinds of metallic hosts. We study 
its feedback effect on conduction electrons around the 
magnetic impurity. 



A. Observable 

The presence of impurities spoils homogeneity of con- 
duction electrons, and their dynamics maintains local 
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properties around the impurity. Then, the Green's func- 
tion of conduction electrons is given by 

G c ^(k,k',r) = -<T T [ CkCT (r)4 v ,(0)]), (33) 

where two momentum indices appear. 

LDOS of conduction electrons can be calculated via 
the Green's function as follows 

Pc*{t,w) = ^e 4(k - k ' ) - r J [G C(Tff (k,k', W +) 



kk' 



G C(J(T (k, k',w )] 



(34) 



where w ± = ui ± i0 + . The local charge density can be 
also expressed via the Green's function 

7i OT (r) = r^^ e ^ k - k ')- r G OT(T (k,k', lWn )e^" 0+ ,(35) 

n kk' 

where ui n = (2n + 1)ttT is the Matsubara frequency. 
The local spin density of states (LSDOS) is defined as 

s c (r, lo) = i^^( k ~ k ^ CTCT ,[G CCTCT ,(k,k>+) 

kk' aa' 

- G CCT(7 ,(k,k>-)]. (36) 

The corresponding local spin density is also given by the 
Green's function of conduction electrons 

S e (r) = e* (k " k,) - r <wG caa , (k, k', iu n y^ 0+ .(37) 

ncrcr'kk' 

In the following we evaluate all these quantities and find 
an important fingerprint of the helical metal in the pres- 
ence of magnetic field. 



B. Friedel oscillation in the helical metal 

In the helical metal the conduction-electron Green's 
function can be expressed in terms of the Green's func- 
tions of ip a and ip a fields 



G^l(k,k> 



1 



2nVkk 

e -i{4>-4>')° 



G^ cr (fc, k',uj) 



2nVkk' 

+ E 6 -^^9 h J(kMe- im ^\ (38) 

where G^ a (k, k', uj), G v>i(T (k, k', u) are the Green's func- 
tions of %l) a and ip a fields, and g^{k,oj) is given in Eq. 
(fT6"|) . (f> (ft) is the angle of k (k') from the x-axis. 

Based on the equation of motion method, the Green's 
functions of tp a and ip a fields can be expressed via the 



impurity Green's function 

G i>c {k,k',uj) = 6{k-k')glf{k,u) 



N\Vf 
2tt 



kk'g^{k,uj)g^{k',u)G f ^), (39) 



-helnj 



G ip(7 (k, k',ui) 



S(k-k') 
r G^ CT (A:,fc ,uj), 



(40) 



where Gf a (u)) is the impurity Green's function. Note 
that Eqs. (f3T))) -(j4T) |) are exact. The slave-boson mean- 
field approximation results in Gf a (uS) = b 2 Gda(uj). 

Inserting the conduction-electron Green's function cal- 
culated by Eqs. ([55 |) -(|5D |1 into Eq. (J33J), we obtain the 
following expression 



where 



DO 

plf{u) = -~lm J dkkg h J(k,^ 



(41) 



(42) 



A/C(r, W ) 



-Im 



uf 



G /CT ( W +)(C(r, W +)) 
+G /i _ CT (a;+)(t^(r,a,+)) 2 ]. (43) 
The functions of t^{r, u) and t\ c \r, uj) are defined as 

oo 

o s 
+ agl_ s (k,uj)], (44) 

OC 

t^\r,uj) = v F J dkU^kr^^sgKh,*), (45) 



where g1 s , (fc, uj) is the bare Green's function of the 7 CT 
field 



P(k,oj) 



UJ + fl - Ek h 

h uj + p + Ek 



(46) 



and J n (x) is the Bessel function<21 

The LDOS [Eq. (|4ip] of conduction electrons consists 
of two contributions. p^(uj) [Eq. (|4"2")l ] corresponds to 
the homogeneous part, not involved with impurity scat- 
tering. On the other hand, A/)^'(r,w) [Eq. (|43|) ] results 
from impurity scattering, varying with the distance from 
the impurity, which reflects modulation of excess charge 
around the impurity. tg^(r, uj) is associated with the s- 
wave scattering channel (m = 0) while ti (r, uj) is related 
with the p-wave (m = — 1) channel, seen from Jo(fcr) and 
Ji(fcr), respectively. The second contribution in (r, uj) 
originates from spin mixing induced by magnetic field. 
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FIG. 2: (Color online) The LDOS of helical electrons 
Ap C(T (r, oj) with and without magnetic field at uj = (r = 
t/vf), scaled with 1/r", where v = 1 for finite magnetic field 
ft and 2/ = 2 for ft = (T = f, A = 50, fj, = O.f, T = O.Of, 
= -6.2). 



FIG. 3: (Color online) The local charge density of helical elec- 
trons An C(T (r) with and without magnetic field (r = v/vf), 
scaled with exp(— ^r)/r", where v = 1, f « 0.0712 for 
ft = 0.05 and v = 2, £ w 0.0628 for ft = (r = 1, A = 50, 
M = 0.1, T = 0.01, = -6.2). 



Using the Lorentzian cutofS^ with A, we obtain the 
f-functions 



2 A(icj + fx — ah) 

tt A 2 — (oj — i^) 2 — ft 2 
r 



x [K ( — y/(w - iy) 2 + ft 2 ) - K (— A)] , (47) 

Up* "Up 



ifV,^) 



A 



7T A 2 - (cj - i^i) 2 - ft 2 



X U( U - ip) 2 + h 2 Ki ( — - i{l) 2 + ft 2 ) 

-AXi(— A)], (48) 

where K n {x) is the modified Bcsscl function^ The mod- 
ified Bessel function has the following asymptotic expan- 
sion for its large argument^ 



(49) 



One can verify that the leading asymptotic behavior 
at large r gives vanishing contributions to the LDOS 
in the absence of magnetic field (ft = 0), providing 
r\<J + [a\/vf ^> 1. In other words, the 1/r contribution 
in to^(r, ioS) is exactly cancelled by that in t\ (r, iu>). 
The next order of the asymptotic expansion gives rise to 
the 1 jr 2 behavior with oscillation, where its frequency is 



2r{uj + fji)/vF, i-e. 

When a weak magnetic field is switched on, the leading 
asymptotic in Eq. (|49[) maintains its non-vanishing con- 
tribution, corresponding to 

Ap™(r,oj)~sm(2r(uj + ri/v F )/r. 

There are three sources which lead to the asymptotic 
1/r. The first is Gf a {uS) ^ G/ i _ cr (w). The second is the 
opening of an effective gap due to the magnetic field. The 
last is the opposite spin scattering contribution, given by 
eg] _ s (k,uj) in Eq. (|44j) . Then, the 1/r contribution in 



Eq. (O does not cancel that of Eq. (gSJ ■ 

In Fig. H]we plot r"Af^(r,u), where v = 2 for h = 0, 
and v = 1 for finite ft. The impurity Green's function 
is calculated within the slave-boson mean-field approxi- 
mation, described in the previous section. This plot con- 
firms the above analysis for the asymptotic behavior of 
the LDOS at large distance r. The LDOS exhibits the 
Friedel oscillation, where its decay changes from 1/r 2 to 
1/r when the magnetic field is switched on. The mag- 
netic field distinguishes the asymptotic behavior of the 
LDOS unambiguously. 

The local charge density can be found from Eq. (|35|) 



nHr)=rC + ArC(r), 



(50) 
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where rig^ 1 is the bare charge density of helical elec- 
trons, and AnJ?°'(r) is the local modulation of the helical- 
electron charge density due to the presence of an impu- 
rity. An^ (r) corresponds to the Ap^°'(r, w) part in the 
LDOS. At large distance r, we find that An^'(r) fits very 
well with the asymptotic expansion exp(— ^t/vf)/^ , 
where v is the same power of the LDOS. £ is not a uni- 
versal parameter, depending on the microscopic detail. 
In Fig. [3] we plot r v cxp(^r/ui?)An^ 1 (r) as a function 
of r. It shows that the local charge density also exhibits 
the Friedel oscillation, where its decay, apart from the 
relaxation part exp(— £r/vp), also obeys the same power 
law as the LDOS. 

In general, the LSDOS of helical electrons does not 
vanish. The z-component of the LSDOS is basically the 
difference of the LDOS for up and down spins. It vanishes 
when magnetic field is absent. When the magnetic field 
is switched on, like the LDOS, the z-component of the 
LSDOS also exhibits the Friedel oscillation and decays as 
1/r at large distance r. The local spin density S*(r) also 
has the asymptotic exp(— £r/vp)/r when the magnetic 
field is finite. The x- and y- components of the LSDOS 
are finite even in the absence of magnetic field as it should 
be. 



C. Friedel oscillation in the soft-gap metal 



Inserting the conduction-electron Green's function cal- 
culated by Eqs. ([51])- ([52]) into Eq. ([M]), we obtain the 
LDOS 



s c |(r,w) = ^^^e ^ ( k - k ')• r [G s c S a(T (k,k', W + ) 



a kk' 



-G s c S Qff (k,k',cO] 



where 



TT 



4r 



ApS(r,u;) = - — Im 



(54) 



(55) 



G/^+)((^M + )r 

+ (^(r,^+)) 2 )]. (56) 

The functions ^(r, u;) and t\ g a (r, uj) are given by 

oo 

t s i(r,u)) = v F [ dfcM>(fcr)5$>Za(fc,w), (57) 
o 

OO 

tH(r,u>) = v F J dkU x {kr)\Y, a 9lAk,"l (58) 



One can calculate the LDOS of conduction electrons 
in the soft-gap metal, following the previous discussion 
in the helical metal. The electron Green's function can 
be expressed in the 7^ basis of Hamiltonian (PHI) 



\-K\fk~k 1 



E\ * im<p—im' </>' aft 



+ 



mm' — 0,-1 St 

((7m6,{k)hl T<7 {k'))) u 



4nk 



s(k - k') e 

mm'^0, — 1 

1 n 1 

ap 



+ /i CT — vpk 



u + + VFkJ' 



(51) 



where ® a p{<j>, ft) = exp[i(l - a)<f>/2 - i(l - 0)<j>' /2] and 

V++ = L V+- = P, V-+ = a , = ap- 

Using the equation of motion method, the 7^ Green's 
function is expressed by the impurity Green's function 

((lmSa{k)\j f m , ra {k'))) ul = S(k - k')6 mm ,5 ST g] a (k,u)) 
N\V\ 2 



■ ' 1 Vfcfc , Cm^Cm'rgg CT (fc,a;)g; CT (fc / ,^)G'/ (T (^),(52) 



where £1 



0+ 



CO- = C-H 



<-l- 

1 



1 and 



w + Ma- - aek 



(53) 



and the bare Green's function of conduction electrons is 
i(k,uj) = Y^9ZAk,")- (59) 



9TA 



Note that the magnetic field in the z-direction does not 
cause spin flipping in the graphene, thus the gap opening 
does not occur, differentiated from the helical metal. 

Using the Lorentzian cutoffi^ with A, we obtain the 
^-functions 



7T A 2 — (ui — ip a ) 2 

x[K (—(u-iHa))-K (—A)], (60) 
vf vp 



A 



TT A 2 — (cj — ipuY" 



x[(lo - ip^K^ — iuj - ip a )) - AK^—A)]. (61) 

VF VF 

One can verify that the leading order in the asymptotic 
expansion of the modified Besscl function in Eq. (|4T)]) 
gives vanishing contributions to the LDOS for any values 
of h. The next order of the asymptotic expansion leads to 
Ap^| ~ sin(2r(w + p a )/vF)/r 2 . This situation is exactly 
the same as the intranodal scattering in graphene^ In 
the present model we take into account only one Dirac 
cone, thus intcrnodal scattering is not introduced. It was 
demonstrated that the 1/r behavior can originate from 
the internodal scattering between two different valleys in 
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graphcnc. The inter- valley scattering gives rise to pseu- 
dospin mixing, resulting in the 1/r behavior. In the he- 
lical metal the magnetic field gives rise to spin flipping, 
allowing the 1/r law. 

In Fig. 2] we plot r 2 Ap^|.(r, w), where the impurity 
Green's function is based on the slave-boson mean-field 
analysis. This plot confirms the 1/r 2 decay of the LDOS, 
independent on the magnetic field. In particular, we 
point out i„ (r, a;) = ^f(r, w) in the absence of mag- 
netic field, explicitly verified from Eqs. (|47]) -(j48 ]) and 
(IM1) - (|61I) . resulting in the completely same Friedel os- 
cillation for both helical and graphene cases. One may 
regard that this equivalence originates from the identical 
effective impurity action for both helical and graphene 
cases without the magnetic field. On the other hand, 
the magnetic field leads the oscillation frequency of the 
1 spin to differ from that of the f spin, where the period 
difference is proportional to the magnetic field strength, 
an important different point from the helical metal. 

We also calculate the local charge density of soft-gap 
electrons. In Fig. [S]we plot r" exp(£r /vF)An s J=(r), where 
v = 2, and £ is an asymptotic fitting parameter. It con- 
firms the asymptotic behavior of the local charge density 
as exp(— £r/vp)/r" . As the LDOS, the decay of the local 
charge density always obeys the inverse-square law inde- 
pendently on magnetic field, apart from the relaxation 
part exp(— £r/vp). 

The z-component LSDOS also vanishes in the absence 
of magnetic field as the helical metal. When the mag- 
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FIG. 4: (Color online) The LDOS of soft-gap electrons 
Ap co -(r, cj) with and without magnetic field at uj — (r = 
r/v F ), scaled with 1/r 2 (F = 1, A = 50, fi = 0.1, T = 0.01, 
E s = -12.4). 
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FIG. 5: (Color online) The local charge density of soft- 
gap electrons An C(T (r) with and without magnetic field (r = 
r/v F ), scaled with exp(-£r)/r 2 , where £ « 0.0628 ( T = 1, 
A = 50, n = 0.1, T = 0.01, E f = -12.4). 



netic field is turned on, the z-component of the LSDOS 
also decays as 1/r 2 at large distance r. Since the Friedel 
oscillations in the LDOS for up and down spins have dif- 
ferent periods, it should exhibit amplitude modulation, 
not shown in the helical metal. One can show that S* (r) 
obeys the asymptotic expression exp(— £,r/vp)/r 2 for fi- 
nite magnetic fields while the other components always 
vanish, different from the helical metal. 

One may ask why the Friedel oscillation reflects spin 
or pseudospin physics although it is basically involved 
with charge dynamics. The underlying mechanism is the 
coupling between the orbital motion of charge degrees of 
freedom and spin or pseudospin dynamics. To control 
spin dynamics with magnetic field changes the orbital 
motion of charge, or to modify charge dynamics by elec- 
tric field governs the spin dynamics via the spin-orbit 
coupling physics. This is one of the main research direc- 
tions in the present condensed matter physics. 



IV. DISCUSSION AND SUMMARY 

In this paper we investigated the Kondo effect and the 
associated Friedel oscillation on the surface of the topo- 
logical insulator, where spins are locked along the mo- 
mentum direction. In particular, we examined the role 
of magnetic field h to distinguish the Kondo effect and 
Friedel oscillation of the helical metal from those of the 
graphene metal, where pseudospins are locked along the 
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momentum direction. It turns out that both the Kondo 
effect and Friedel oscillation of the helical metal are com- 
pletely identical to those of the standard soft-gap Ander- 
son model in the absence of magnetic field. However, the 
magnetic field was shown to play a different role for each 
case. 

We found that the spin f and 4- splitting energy of the 
Kondo peak does not follow the typical /i-linear behavior 
of the soft-gap Anderson model. We revealed its physi- 
cal origin and derived the analytic expression. In addi- 
tion, we showed that the Friedel oscillation of the helical 
metal changes from the typical 1/r 2 law associated with 
the Dirac spectrum to the 1/r behavior, applying mag- 
netic field in the z-direction while it still remains as 1 jr 2 
in the graphene case. We clarified physics behind this 
change that magnetic field gives rise to spin mixing be- 
tween j" and I in the helical metal, resulting in gap. We 
pointed out that this mechanism is quite analogous to the 
internodal scattering in the graphene case^ introducing 
the pseudospin flipping. We propose the Kondo effect 
and Friedel oscillation as the fingerprint for the surface 
state of the topological insulator, measurable by Fourier 
transformation scanning tunneling spectroscopy^^— 

An interesting issue not discussed in this study is on 
Ruderman-Kittel-Kasuya-Yosida (RKKY) correlations. 
It was demonstrated based on the variational wave- 
function approach that the spin-orbital quenching results 
in anisotropy for spin dynamics, leading spin correla- 
tions of the topological surface different from those of 
graphene which are SU(2) symmetric^ This nontrivial 
spin dynamics in the topological surface gives an inter- 
esting problem. Increasing magnetic impurities, which 
kinds of spin dynamics will appear as a competition be- 
tween the Kondo effect and RKKY correlation? This 
research direction opens a novel window for the interplay 
among interactions (Kondo and RKKY), disorder, and 
topologyj22r— 



([2]) can be diagonalizcd by the unitary transformation 



u{4>) 



l ( e -i<P/2 e -i4>/2 



V2 



irp/2 



itp/2 



(A.l) 



This unitary transformation matrix has its period 4-7T, 
and the Berry phase tt is acquired when an electron en- 
circles the Fermi surface. It has been chosen to study the 
Kondo effect in the helical metal, based on the variational 
method^ 

Proceeding in a similar way as in Sec. II, we obtain 

oo 

H Li = Ys] dks k a 7 t a (k) 7ma (k). (A.2) 

ma q 

The hybridization Hamiltonian becomes 
vNV 



hoi 



where 



and 



^-J^ V / dkVkf^ s (m) lms (k) +K.c, (A.3) 



am) 



Sjn Sm 



V2 i 



(A.4) 



7T 2m± 1 

It should be noted that the hybridization Hamiltonian 
in this 7cr basis couples the impurity for all angular mo- 
mentum m, much different from the case of the helical 
metal. 

We introduce new operators for diagonalization 



1 



lpm±{k) = -^=(7 mt (fc) ± Jmi(k))- 



(A.5) 



Then, the Hamiltonian ([T]) is written as follows 

oo 

flhei = ^2 dkek[ipm + (k)^i m -(k) + ipm-(k)ip m +{k)] 
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Appendix: Comment on the unitary transformation 



We consider another choice of the unitary 
transformation j 24 ' 25 The helical electron Hamiltonian 



^2 / dk^„^ m(T {k)i) m(T {k) 



N =~Y,j dkVkf^ m ^ m Ak) + H.c. (A.6) 



Integrating over the field, we obtain the effective 
impurity action 

Shoi = 2 / dTft(r)[6 aa/ 5(T-r')(d T +E fa ) 

+ K aa ,{T-T')]f a ,{T') + U J drn{(r)n{(r),(A.7) 
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where 



A aa >(iu) 



and 



N\V[< 



^2 J *fc<w(Mw)CT(C 



i (fc, iui) 



Calling E m Cm CT (^ 



r t 1 



f n 



/2, we obtain 



(A.8) 



(A.9) 



(A.10) 



Thus, the effective action [Eq. (|A.7[) ] is completely iden- 
tical to the one [Eq. ([17])] . 



The reason why the single-valuedness of the unitary 
transformation is not relevant for impurity dynamics may 
be the fact that the Berry phase contribution is inte- 
grated out, not affecting the local dynamics. Then, the 
feedback effect of the impurity dynamics to conduction 
electrons may be modified by the double-valued unitary 
transformation. Actually, all angular-momentum chan- 
nels are coupled to the impurity. This will be addressed 
near future. 
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